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Abstract 

Suppose that attached to each site z € Z is a coin with bias 9{z), and only finitely 
many of these coins have non-zero bias. Ahow a simple random walker to generate 
observations by tossing, at each move, the coin attached to its current position. Then 
we can determine the biases {9{z)}z£i,, using only the outcomes of these coin tosses 
and no information about the path of the random walker, up to a shift and reflection 
of Z. This generalizes a result of Harris and Keane. 
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1 Introduction 

A coin toss with bias 6* is a { — 1, l}-valued random variable with expected value 9, and a 
fair coin is a coin toss with bias zero. 

Harris and Keane [ HK97] introduced a model for sequences of coin tosses with a par- 
ticular kind of dependence. Let S = {Sn}'^=Q be simple random walk on Z. Suppose that 
whenever Sn = 0, an independent coin with bias ^ > is tossed, while at all other times an 
independent fair coin is tossed. Suppose that we are given X = {Xn}^^Q, the record of coin 
tosses obtained, but the path of the walker, 5", is hidden from us. Can X be distinguished 
from a sequence of i.i.d. fair coin tosses? 

If it can be distinguished, can the parameter 6 be recovered, again only from X? 
Harris and Keane proved the following: 

Theorem ( [HK97|, Theorem 2]). There exist a sequence of functions B„ : { — 1, 1}" —>■ 

not depending on 9, so that lim„^oo ^ni^i, ■ ■ ■ , ^n) = 9 almost surely. 
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In fact, the model in |HK97j is more general, allowing the walk to be any null- recurrent 
Markov chain. Let fig be the distribution of X on {—1, 1}^. Recall that two Borel measures 
are mutually singular if there is a Borel set which is null for one measure such that its 
complement is null for the other measure; in this case the measures are distinguished by 
almost any observation. Whether or not fig and fiQ are mutually singular depends on the 
graph, and as was shown in |LPP01j . sometimes on the bias 6. |HK97j provides a partial 
criterion for determining singularity based on the graph, while the full story - in particular 
the role of 6 for certain graphs - is completed in |LPP01j . 

In this paper, this model is generalized in a different direction. Label each z G Z with 
6{z) G [0, 1]. Now allow a random walker to move on Z, and suppose that on her nth move 
she is at position Sn and she tosses a coin with bias 6{Sn), generating the random variable 
Xn- Again, the path of the walker, {S'^jJ^g ^ot observed, and the output is only the 
outcomes of the coin tosses, that is, {X„}^q. The main result of this paper says that the 
biases {0{z) : z E 1^} can be recovered, up to a shift and reflection of Z, in the case when 
the number of vertices with 6{z) 7^ is finite: 

Theorem 1.1. Suppose that attached to each site z E Tj is a coin with bias 9{z), and only 
finitely many of these coins have non-zero bias. Allow a simple random walker to generate 
observations by tossing, at each move, the coin attached to its current position. Then it is 
possible to determine the biases {0{z)}zez, up to a shift and reflection of 7j, using only a 
single observation of the infinite sequence of these coin tosses and no information about 
the path of the random walker. 

Another related model was introduced by Benjamini and Kesten |BK96j (and indepen- 
dently, by Den Hollander and Keane). Instead of attaching a coin with bias 6{z) to each 
2; G Z'', a fixed color is assigned to each vertex. The random walker reports only the 
sequence of colors visited, while just as in our generalization of the Harris-Keane model, 
the path itself is hidden. Further investigations of the model introduced in l5K!)(i| can be 
found in |How9e)a[ IHow96b[ ILin99l ILM()2[ ILMOI-il IMM IMH.OI-ial IMHOSbj and a survey of 
results (up to 1998) can be found in |Kes98j . 

This paper is organized as follows. Theorem 11.11 holds more generally, where the ob- 
served random variables are not restricted to be coin tosses. Some definitions and the 
statement of the more general Theorem 12.31 can be found in Section |21 The main require- 
ments of the proof of this theorem are a strong law of large numbers, and some algebraic 
results, found in Section IHl Because the special case of coin tosses is more readily under- 
stood, a separate proof of Theorem II. II is supplied, after which Theorem 12. 31 is proven, both 
in Section I3J Finally, some unsolved problems are mentioned in Sectional 
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Figure 1: A walker performing his coin flips. We only see the right-hand column, but would 
like to recover the center column! 

2 Definitions and Statement of Result 

Let g be a probability mass function on Z, and g*" its n-fold convolution. Assume that 

^^2;g(z) = and ^^2;^g(z) < oo. (1) 

Also, we will assume that q is symmetric: 

q{z) = q{-z) for all z G Z . (2) 
In addition, to simplify the exposition we will suppose that 

g.c.d.{n : g*"(0) > 0} = 1. (3) 

Remark. Condition Q rules out, for example, q = + the mass function corre- 
sponding to the increments of simple random walk on Z. However, the results in this paper 
(in particular. Theorem 12. 3p can be obtained for periodic random walks by considering the 
process observed at times {rn + k : n & N}, where r is the period (the left-hand side of 

©)■ 

The random walk with increments distributed according to q will be denoted S = 

— Sn = Z \ So, . . . , Sn] = q{z) . 

We use the notation P"(;z, w) =^ P[5„ = w \ = z] and u„ = P"(0, 0). 
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Definition 2.1. A stochastic scenery is a map 77 : Z — 'P(M), where is tlie set of all 

probability measures on M. 

We assume that there is a known reference distribution a G P(M) which appears every- 
where but finitely many vertices: that is, 

\V-\V \ {a})\ < 00 . (4) 

Definition 2.2. The sequence of observations induced by S and t] is the stochastic process 
X = {X„}^Q, whose law conditioned on 5* has independent marginal distributions given 
by P[X„e- \S]=r]{Sn). 

Theorem 2.3. For a random walk S with symmetric increment distribution q satisfying 
ID) and and stochastic scenery rj obeying let X = {X^jJ^g the observations 
induced by S andrj. Then using only the observations {X„},^q, we can determine a scenery 
fj so that 

fj = rj o T a.s. , 

where T : Z — > Z is either a shift or a shift composed with a reflection, and may depend on 
V- 

Remark. As noted by a referee, if we are given an infinite sequence of observations then we 
do not need to be given the reference distribution a, as it can be a.s. reconstructed from 
the observations. 

3 A few ingredients 

In this section, we first state Proposition 13.21 which shows how the observations {Xn} can 
be used to determine a family of parameters {pt}- We show in Proposition 13.71 that we 
can express a new family of parameters {Q^} as functions of {pt}- These new parameters 
determines the scenery rj, and hence the scenery can be recovered from the observations 
{Xn}- (This is the substance of the proofs of Theorem II. II and Theorem 12.31 in Section 0]) 
We conclude the present section with a proof of Proposition 13.21 

Definition 3.1. (i) For a vector t E N'' (where k eN), and a bounded and measurable 
: M ^ M, define 

p,(^) ^E[^(Xo)^(X,J^(X,,+,J ■ ■■ifiX,,^...^,J I So = z]. 
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(ii) For r e N, let p'^{ip) be the vector with components 



{ptiip) : te{l,...,r}'=}. 



For measurable functions (p, we will use the supremum norm ||v^||oo- When we know 
that all the measures rj{z) are supported on a common set E, we will take this norm to be 
the essential supremum over E. For example, when we are dealing with coin tosses only, 
llv^lloo < 1 means that ip is bounded by 1 on {—1, 1}, a condition satisfied by (f{x) = x. 

Proposition 3.2. Fix a m,easurable function with \\^p\\oo < 1 J^pda = 0, and a 
vector t e N"*. Then there exists a sequence {qn} of measurable functions, qn '■ — >■ 
not depending on the stochastic scenery rj, with 

lim gr^{Xi, . . . , X^) — Pt{f) almost surely. 

AT— >(X) 

The information in the collection {pt} must be transformed into a more useful form 
for us to recover the stochastic scenery rj. We provide now several results enabling this 
transformation. 

Lemma 3.3. For a given transition semigroup , and m, r e define the matrix M as 



M 



def 



PHO,0) PH0,1) 
P2(0,0) P2(0,l) 

P''(0,0) P''(0,1) 



PnO,m) 
P2(0,m) 

P''(0,m) 



(5) 



Let S he an aperiodic and symmetric random walk on whose increments have probability 
mass function q: that is, ^[St+i — z \ St — w] — q{z — w). 

(i) //P* is the transition semigroup for S, then M has rank (m + 1) for some r. 

(ii) If S is the simple random walk on Z. and P*(0, z) = F[S2t = 2;^], then any (m + 1) x 
{m + 1) square submatrix of M is non-singular. 

Proof. If ip is the characteristic function of q, so that ip^ is the characteristic function of 
the tth convolution power of q, then by Fourier inversion 



^ I cos{uj)ij\u)du = 2F[St = j]. 



(6) 
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Suppose that for each r, the m + 1 columns of M are hnearly dependent, that is, there 
exist {aj{r)}Y=Q (not all zero) so that 

m 

^aj{r)P\0,j) = for alH < r . 

j=0 

By rescaling, it can be assumed that Yl^=o '^i(^)^ ~ ^- Thus there exist subsequential limits 
{aj}™^Q (not all zero) so that 

m 

^ajP*(0,i) = for alH. (7) 

j=0 

Hence, the matrix M in ((H)) fails to have rank (m + 1) for any r if and only if there exist 
{0'j}]Lo satisfying ((7j). By (jH)), this is the same as 

/n 
g{u)i)\u)du = for all t, (8) 
-n 

where g{u) = "^^^oaj cos{uj). We now show that (jH)) cannot hold: 

Observe that g is an even function that is non-zero in a neighborhood of 0, except 
possibly at 0. It can be assumed without loss of generality (by multiplying the coefficients 
aj by —1) that g is non-negative near 0. Also ip is even, has value 1 at the origin, and is 
positive in a neighborhood [—6, 6] of 0. 

Choose 6i < 6 so that 

B =^ min tp{u) > max tp{u) == A 

\u\<Si S<\u\<n 

This is possible because, as is a characteristic function of an aperiodic distribution, A < 1. 
Choose 6i even smaller to ensure mmsi^^^^^g^g{u) = e > 0. Hence 

g{u)il/{u)du = I g{u)il/{u)du + I g{u)il/{u)du 

J-S J[-TT,7t]\[~5,S] 

> I g{u)i)^{u)du+ I g{u)i)^{u)du 

JSl/2 J[-7T,n]\[-5,S] 

>|e5*-||(7|U27rA*. (9) 
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For t large enough, the right-hand side of © is positive, contradicting (jHI). Thus the 
matrix (0) has rank (m + 1) when r is sufficiently large, proving (i). 

We now discuss the special case of simple random walk. Suppose there exist ao, . . . , 
and to, ti, . . . ,tm & 21, so that for t = to, . . . , tm, 



Y,aknS2t = 2k]=0. 



k=0 

Then 



m 



Multiplying both sides of (fTUj) by yields 

m 

= ^ ak{t + m) ■ ■ ■ (t + k + l)t ■ ■ ■ {t - k + 1). (11) 

A;=0 

If fk{x) =^ (x + m) ■ ■ ■ (x + /c + l)x ■ ■ ■ {x — k + 1), then (fTTj) shows that 

m 

def 



fix) = akfk{x) = for X = to,. . . ,tm. (12) 



fe=0 

Since / is a polynomial of degree m, and by ()12j) / has m + 1 zeros, it follows that / = 0. 
But /(— m) = implies = 0. 

Multiplying both side of (fTUj) by and arguing as above shows that a^-i = 0. 

Repeating this procedure shows that = for all k, establishing (ii). ■ 

Remark 1. We have suppressed the dependence of the r x (m + 1) matrix M on both m 
and r. For each m, fix an so that Ai" has rank (m + 1). In the sequel, the matrix M 
will depend only on m, having dimension x (m + 1). We will write r for r^- 

We now introduce some notation: 
Definition 3.4. For any function : M — M, define 

Tp{z) =^ / (fdri{z) , and y^o *= — / V^'ict • (13) 
Jr Jr 

(Recall that ri{z) G P(M).) 
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The parameters {Q'^if)} which will be used in the reconstruction of the scenery are 
now defined: 

Definition 3.5. For (f a bounded measurable function and A; G N, define the vector 
Q''{ip) e MH*^ indexed by d G [m]^ by 

Qd{^)= E ^(^iM^2)---^(^fc+i). (14) 

{zi,...,Zk+l) 

(Here [m] =^ {0, 1 . . . , m}.) 

Assumption of Theorem 12 .HI requires that the stochastic scenery rj differs from a 
reference distribution a at only finitely many vertices. With this in mind, we make the 
following definitions: 

Definition 3.6. Let 

a =^ inf{j : r]{j) ^ a}, b =^ sup{j : r]{j) ^ a}, and i'^ b — a. (15) 

By assumption (jH), — oo < a < 6 < oo. 

Finally, we state the main algebraic result used in the proof of Theorem YI.'Al 

Proposition 3.7. Ifm>i and J ipda = 0, then Q^{(p) G IRl'"!*' is a linear transformation 
of p^{(f) G (defined in Definition s^. 1\ ) 

Proof. Let us begin with the case oi k = 1. Let M be the matrix in 0, and M' its left 
inverse, shown to exist in Lemma fH. HI 
We have 

= 5^ 5^E[^(Xi)^(Xo) \S^ = z,St = w]¥[St = w\So = z] 

= 5^P*(0,rf) n^Mw). (16) 

deZ (z,w) 

Because q is symmetric, we have P*(0,(i) = P*(0, —d), and hence from (fTBj) we conclude 
that 

oo 

p,(^) = Ep*(o,rf) vi^Mw). 

d=0 {z,w) 
\z—w\=d 
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li d> m, then d> i and the factor J2\z~w\=dV{^)f{'^) vanishes, so we have 

m 
d=0 

Using Definition 13. H we rewrite the collection of r equations (fTTj) as 

p\^) = MQ\^). 

Multiplying both sides of (HH) on the left by M' yields Q\ip) = M'p^{ip). 
Now consider the case k = 2. We have 

X P^'{0,w - z)P^^{0,v -w) 



(17) 



V — w] 



oo oo 



di=— oo d2=~oo 



w—z=d\ ,v—w=d2 



oo oo 



5^ 5^p*Ho,^^i)P*Ho,d2) Y n^PH^v) 



{z,w,v) 
\w—z\=di,\v—w\=d2 



di=0d2=0 

Again, since ^\z-u]\=dT.\w-v\=do^i^)'^i^)^i'^) vanishes for di y d2 > m > i, we have 



j\z—w\=di,\w—v\=d2 

m m 



(19) 



ii=0d2=0 



{z,w,v) 
\z-w\=di, 
\w—v\=d2 



Recall that the tensor product of the matrix M in (jS)) with itself is given by 

MiflM ■ ■ ■ Mi,„M 



M (g) M 



M,oM ■■■ MrraM 



There are rows, indexed by t G {(ti, ^2) '■ 1 < ti, t2 < r}, and (m + 1)^ columns indexed 
by d G [m]^ = {{di, ^2) : di = 0,1, ... , m}. Each row is of the form 

{pHo,d,)PHo,d2))2^^^^^. 
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Thus we can rewrite the equations (|19|) for t G [r]^ compactly as 



p\^) = {M®M) Q\^). 

Because each M has rank (m + 1), the matrix M (g) M has rank [m + 1)^ (see |HJ9H 
Theorem 4.2.15]). Thus there is a left inverse {M ® M)' to M (E) M and we can write 

Q\^) = {M^Myp'i^). 

In general, M^® has rank (m + l)'^, and hence has a left inverse, enabling us to write 

Q\^) = {M'^)'p'i^). (20) 



Remark 2. The vectors p'^{(p) depend on the constant r (see Definition 13. 1|) . which we 
have taken to be the constant defined in Remark ^ Thus these vectors depend on m, 
although we have again suppressed this dependence in the notation. 

Lemma 3.8. Let i be the constant given in Definition \3.b\ Then there exists a se- 
quence of random variables {(!-n}'^=o, not depending on rj, with measurable with respect 
to cr(Xi, . . . , Xn), and so that in = ^ eventually, a.s. 

Recall that a class $ of measurable functions on M is said to be measure determining if 
(fd^ = Jjg (fdu for each G $ implies /i = z/. Let $ be a countable measure determining 
class of functions on M with Hv^Hoo < 1- We will enumerate $ as {(fi,ip2, ■ ■ •)• Also define 
$1 =^ { ||/+cg| • /'fl' ^ "^i ^ enumerate its elements as {h^, h"^, . . .). 

Lemma 3.9. Let fi and v be two probability measures, neither equal to a. Recall that 
ipo = ip — J ipda. If ^ ^ u, there exists ■?/' G $i with 

J ipodfx , J ipodu , and J ip^d^ ^ j ipodu . (21) 

Proof. Because ^ v and $ is measure determining, there is an / G $ so that J /rf/i ^ 
J fdv. By subtracting J fda, we have / fod^i ^ J fodu. Then one of / fodfi and / fodu is 
nonzero; without loss of generality assume J fodfi ^ 0. Similarly, there is a (7 G $ so that 
/ gdu 7^ / gda, that is, / godu 7^ 0. 

Hence, for small enough c G Q, we have 

//„d^ + c/*d,^0. aud //„d. + c/9„<i.^0. (22) 
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By taking c even smaller, since J fod^ 7^ / fodi', we have 

fodfi + c Qodfi ^ / j^dv + c I Qodu . (23) 



Thus, if = j^^^, so that ipo = ^qf§f^, we have from ^ and ^ that ip obeys 
(EH). °° °° ■ 

We can now proceed with the proof of Lemma 13.81 

Proof of Lemma \S. 8[ As before, let M' be the left inverse to the matrix M in 

Let =^ sup{|2; — w\ : hQ{z)ho{w) 7^ 0}. Recall that {h^, h"^, . . .) is an enumeration of 
$1, and write P for Lemma 13.91 guarantees that supj^^P = i for r sufficiently large. 
Define 

T(m,/i) = 7r„+i(My(/io)), 

where tt^+i is the projection onto the m + 1st coordinate. 
Notice that 

T(™.ft)=(2:,-„M.M*(»)/0 Ura = i- 

^ ^ [0 ifm>£\ ^ ^ 

By Proposition 13. 2[ there exists for each m and j a sequence of random variables 
{Tr{m, so that almost surely, 

lim Tr{m,j) = T{m, h^) . 

r^oo 

Let {s„} be any sequence with lim„^oo s„ = 00. An examination of the proof of Proposition 
13. 21 shows that there are bounds on the variances of Tr{m, j) uniform for m < Sn and j < Sn- 
In particular, there is a sequence fr with lim^-^oo /r = so that 

sup E [Tr{m,jf] < fr . 

i^<m<Sn 



We have 

P 



U U Vrim,j)>-\ 



J=l m=ij+l 



< s^n^ sup E [Tr(m,j)^] 

<s'yfr. 
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Let {Bn} be a sequence so that s^ji^ fs^ is summable. By Borel-Cantelli, almost surely 

TB„(m,j) < — for f < m < s„, and 1 < j < s„, eventually . 
n 

Similarly, since limr^oo^r(^-', j) = T{i^,j) ^ 0, we can take a subsequence of {-Bn}, which 
we will continue to denote by {-Bn}, so that almost surely 

^B„(^^i) > - for 1 < j < eventually. 

n 

To summarize, the following holds almost surely: For n sufficiently large, for all j = 

1; • • • ; 

TBr,i^^,j) > "-"^5 while TB„{m,j) < n^^ for m = F + 1, . . . , . 
Consequently, 

sup |m < s„ : TB„{mJ) > i| = F for 1 < j < s„ , 
for n sufficiently large. Finally, 

sup sup lm<Sn : Tb„ (m, j) > — \ = sup ^-^ = £ 
for n sufficiently large. [Since supj<^ = i for all but finitely many r.] 

■ 

We still need a proof of Proposition 13.21 it is similar to the proof of |LPPOH Theorem 
6.1]. Recall that m„ = P"(0, 0). The only facts we need about P"^ are 



E< = ^' (25) 



n=0 

and 



lim — - — 7—^ — - = 1 for all u,v, z,w & Z and ?', A; G N . (26) 

~ - P"-J(u,'y) ^ ^ 



n— >oo 



That the transition probabilities satisfy ()25p and ()26p is easily seen from a local central 
limit theorem, for example |WoeOOt Theorem 13.10]. 
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Proof of Proposition IJ.M For 

n 

w{m,n) = ul and = ^(Xfc)v?(Xfc+tJ ■ ■ ■ (/?(Xfc+t,+...+tJ, 



k=m+l 

define the linear estimator 



Lm,n — — 7 T WfcZfc. (27) 

w[m,n] ^ — ^ 

^ ' ' k=m+l 



Notice that E[Lm,„] = ELm+i '^lPt,k{v)^ where we define 

Since hnifc^oo = 1 for 2:, it follows that Yrnik^^pt^ti.^) = Pt{<^) and 

lim E[L^.„] =pt((/.). (28) 

m^oo 

The strategy of the proof is to find sequences {rrii} and {ui} so that 

1 ^ 

lim — =pt(v9) almost surely . (29) 

i=l 

We prove ()29|1 by showing that Cov{Zj, Zk) is small for \j — k\ large, and consequently 
Cov{Ljn„n,,Lmr,nr) IS Small for \i - r| large. 
For z G Z'^"''-'^ and j G N, define the event 

Ht{j, z) = {Sj = zq, Sj+ti = zi,. . . , Sj+ti+-+t^ = Zs}. (30) 
Then by conditioning on positions of S, 

Suppose that A; > j + ti + ■ ■ ■ + t^. Notice that 

s s 

E[Z,Zfc I HtU, z) n i/t(A;, zz;)] = n^(^^) H^^^^')' (^1) 
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and 

¥[Ht{j, z) n Ht{k, w)] = P\0, zoMHtU, ^) I S, = zo] 
Combining (^1]) and (jH^ shows that ¥\ZjZk\ is equal to 

X P'^-^^'+'^+'-'+'^Hz,, i/;o) mtik, w)\Sk = Wo] . (33) 
By similar reasoning, E[Zj]E[Zfc] is equal to 

E ( 11^(^^)11 ^K)) ^'(O'^o) nHtij,z) I S, = Zo] 

z,ioeZ«+l \i=0 j=o / 

xP\0,Wo) F[Ht{k,w)\Sk = Wo]. 

Because of the definitions of a and b in (fT3j) . if D > |a| V \b\, then for any z G Z with 
|2;| > we have Tp(z) = 0. 
Thus if D > \a\ V 

I Cov(Z„ Z,)| = I E[Z,Zfc] - E[Zj]E[Zk] \ 

< ^'(O'^o) \P'-^'^''^-^''\zs,wo)-P'{0,wo)\ , (34) 

-i?<20<£' 

-D<m;o<D 

since \\ip\\oo < 1- 

For sequences {nii}'^^ and {nj}^^ with nii < Ui, define 

h = L^.,n. = ^^J^^^ ^ "^-^r (35) 

For any sequence {ej}, and integer D, we will inductively define sequences {rrii} and {rii} 
so that for t > i, 

|Cov(L„L.)| <Ce,, (36) 
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provided D > \a\ V For now, assume that D is indeed chosen so that D > \a\ V To 
begin, let mi = ni = 1. Now assume that the pair {mi,ni) has aheady been defined. Pick 
mj+i large enough so that 

if i < Hi and k > mj+i, then 

\pk-ij+ti+-+ts)^^^^^ _ p'=(o,m;)| < Ci{D)eiUk for all - D < z,w < D. (37) 



This is possible by fEH|) . 
Next, pick nj+i so that 

w(mi+i,rai+i) > w{mi+i) , 

where w{m) '= w{0,m). Combining (j34p and (j37p shows that 

I Cov{Zj,Zk)\ < {2Df Ci{D) e^UjUk = C2{D)eiUjUk 

for j < Hi and k > rrii+i. 

From the definition ()35|) and the bound ()39p we have 



|Cov(Li,LO 



1 



Ui rir 



w{mi, Ui) w{mr, rir) 



j=mi+l fe=mT+l 



< 



j=mi+l fc=m,T+l 



Next, we show that 



Notice that 



supE[L^] < M < oo. 



(38) 
(39) 



(40) 



w[mi,ni) 



2 UjUkK[ZjZk] + 2 UjUk^[ZjZj^ 



mi<j<k<ni 

\j-k\<ti + -+ts 



mi<j,k<ni 
j+tiH hts<fe 



(41) 



By 



for each fixed k, we have limi 



1, and hence Uj^k < C'aWj for k 



0,1, ... ,ti + ■■■ + ts- Consequently, since Hv^Hoo < 1 and hence ZjZk < 1 



mi<j<k<ni 
\j-k\<ti+-+t. 



UjUkE[ZjZk] < (ti H h ts)C3 ^ j = Ciw{mi, ni) 

j=mi+l 



(42) 
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Since KlZjZk] is equal to we have 

D D D 

zq=—D Zs=—Dwq=—D 

again by (|^. Thus, 



mi<j,k<ni j=mi+l k=i+l 

i+tiH l-ts<fc 



Now applying the Cauchy-Schwarz inequality yields 



X ^kUk-j < \/w{j, ni)w{l,ni - j) < w{ni). (44) 
k=j+i 



Plugging (jHl) into ^ yields 



2 X %UfcIE[^j^fc] < C6(-D)w(ni)ty(mj,ni) . (45) 



mi<j,k<ni 
j+ti-\ Hs<k 



Then, using (gSI) and (021) in (gH) yields 



w{mi,ni) w[mi,ni) 
Now, since by (jSHI) wimi^rii) > w{mi), it follows that w(nj) < 2w{mi,ni). Hence, 

w{mi,ni) 

where M doesn't depend on i. 

If we choose = then a strong law for weakly correlated and centered random 

variables (see |Loe78| Theorem 37.7.A]) applied to the sequence {Li — E[L.j]}i>i implies 

that j^^Zi {U-E[Li])^0. 

Thus, from (j2HI), we have limj^oo E[Li] = pti^p) and Y^iLi ~^ Pt{<^)- 
To summarize, for each D we get a sequence of functions {g§}j^_-^ so that 

ifD>|a|V|6|, then f7^(Xi,...,X^) ^^pt((^) a.s. (46) 
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By a diagonalization argument, there is a sequence of integers {r„} so that for each D, the 
hmit A{D) =^ hm„ (^^(Xi, . . . exists, and moreover for each 

\g^SXi. ■ ■ • , ^rj - A{D)\ < n-' for n > D . 
From ()46|) it follows that A{D) = pt{<^) for D > |a| V and consequently a.s. 

rxi,...,x,,j^M^). 



4 Proofs of Theorem 11.11 and Theorem 12.3 

Here is an outline of the proof of Theorem 12.31 In the last section, it was shown in Propo- 
sition Eill that the parameters {pt} can be recovered from the data {Xi, X2, . . .}. We 
transformed these parameters in Proposition 13 . 71 into the family {Qd}- Now we must show 
how to use this information to determine the laws {77(2)}. 

Before we prove Theorem 12.31 in its full generality, we offer the proof of Theorem II. ![ 
the case where the observable random variables are coin tosses. The exposition is much 
clearer in this special case. The proof is given in its full generality later in this section. 

Theorem II. IL Let S be a symmetric and aperiodic random walk, and label each 2; G Z 
with a coin having bias 9{z). If only finitely many vertices have 6{z) 7^ 0, then there 
exist a sequence {6n\'^=Q with On measurable with respect to cr(Xi, . . . ,Xn), and a shift and 
reflection T (depending on rj) so that 

lim 9n{z) = 60 T{z) for all z E 1j , a.s. 

n— >oo 

Let us first introduce some notation. 

Definition 4.1. Let (xi,X2, . . . be a finite, ordered sequence. Define [xi,X2, ■ ■ ■ ,x„] 
as 

[XI,X2, ...,Xn] = {{Xi,X2, . . . ,Xn), {Xn, Xn-1, ■ ■ ■ , Xi)} . (47) 

Proposition 4.2. Let 6 : ^ [0,1] have compact support. Then, given i = b — a as 
defined in (fT^ . 

[e{a),eia + l),...,9ib-l),9ib)] (48) 
can be uniquely determined from {p''{I)}, where I is the identity map. 
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Proof. We will write for Q^{I), where / is the identity map. 

By Proposition 13.71 it is enough to construct (PS|) using only {Q^}- 

Our method will be to first determine the biases at a and b, and then work inwards. 

In the case where k = 1 and d = {£), we have 



2 

(^1,^2) 

\z2—zi\=£ 

as the only pairs (zi, Z2) with \z2 — Zi\ = i and with 9{zi)9{z2) 7^ are (a, b) and (6, a) 
Notice that 



^ ^(zi)^(;22)^(;23) = ^(a)^^(6) {^^(a) + 9{b)} 



{zi,Z2,Z3) 

\z2-zi\=e, 

\zz-Z2\=l 



and so Qia) + 6{b) = 2Q'^^^^/Qj. We can conclude that 

(eja) + e{b)) ± v/(g(a) + e{b)y - Ae{a)e{b) \ 
2 J 



{9ia),eib)} 



Now we move on to the unordered pair {6{a + 1), 6{b — 1)}. Notice that 



2 

1) 



9{z,)9{z2)9{zs) = 9{a)9{b) {9{a + 1) + ^(6 - 1)} , 



(^1, 22,^3) 

\Z2—Zl\=l, 
\Z3-Z2\ = l 



and 



QliMi) = E 9{z,)9{z2)9{zs)9iz,)9iz,)9ize) 



{zi,Z2,Z3,Z4,Z5) 
\Z2-Zi\=e,\z3-Z2\ = l, 
\Z4-Z3\ = l,\z5-Z4\=e 
\Z6-Z5\ = 1 

= 2 {9{a)9{b)}^ 9{a + l)9{b - 1) . 

Hence, 

9{a + l) + 9ib~l) = 2Ql,^^-^/Ql and ^(a + 1)0(6 - 1) = 2Q^, , 1,1)/ (Q.^)' 
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and so the unordered pair {9{a + 1), 9{b — 1)} can be written as a function of (Q^, . . . , Q^). 

The cross-product e{a)9{a+l)+e{b)e{b+l) allows us to write [9(a), 9{a+l), 9{b-l), 9(b)] 
as a function of the unordered pairs {9(a), 9(b)} and {9(a + 1), 9(b — 1)}. We have 

Qh,i) = E 9(z,)9(z2)9(z,)9(z,) 

{zi,Z2,Z3,Z4) 
\Z2—Z\\ =£, 1 23 — ^2 I 
\z4-Z-i\=\ 

= 9(a)9(b) {9(a)9(a + 1) + ^(6)^(611)} , 

and so 

9(a)9(a + 1) + 9(b)9(b - 1) = 2Qf,^,^,-^/Ql . 

We conclude that [9(a), 9(a + 1), ^^(6 — 1), 9(b)] can be written as a function of the {Q^}- 
Continuing in this way, we work down to the center to obtain ()48p. using only {Q^}- B 

Proof of Theorem \l.l\ If ^ is given, then by Proposition 14.21 it is clear that the theorem 
holds. That is, for each £, we can construct a scenery 6^^ depending only on a(Xi, . . . , X„) 
measurable random variables, and so that 9^ ^ 9 oT. Then by Lemma (3. 8| the sequence 
9^ will satisfy the requirements of the Theorem. ■ 

We now provide a proof of our result in its full generality. Recall the notation given in 
Definition 13.41 As r](z) is a probability measure on M for each ^ G Z, 



(p(z) = / (fdr](z) , and ipo = cp — I (pda . 
Jr Jr 

Proof of Theorem \2.'^ We will show how to use the collection Q =^ {Q'^(</3)}ipe<i>i,fcGN and 
i to construct a stochastic scenery which is a shift and/or a reflection of rj. The conclusion 
of the Theorem will then follow from applications of Proposition 13.21 Proposition 13.71 and 
Lemma 13.81 similarly to the proof of Theorem 11.11 
Fix a bounded and measurable ip. We have that 



Q](p>o) = 2p)o(a)^o(b) , 
Q'{e,e)ifo) = ¥o(a)'^(b) {^(a) +^(6)} . 

Assume first that Tp^(a)'(f^(b) ^ 0. In this case, we can solve in to obtain 

^(a)^(6) = Q^(v9o)/2 and ^(a) + ^(6) = 2Qj^^^)(v5o)/<5l(v5o) • (50) 
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We use the identities in (fHUI) to get 



{(^o(a),<^o(&)} 



± 



(51) 



We proceed inductively: assume we have determined, for k < i/2, 

{(^(a), . . . ,^(a + k- 1)), (^(6), ...,^{b-k + 1))} . (52) 

We have 

.k,k/)M = (W(a)W(^))^ {¥o{a + k)+ Tp^ih - /c)} , ^^^^ 
;,fc/,fc)(¥'o) = 2 (^(a)^(6))^^(a + k)-^{h - k) . 

By assumption, Tp^{a)Tp^{h) ^ 0, so we can solve in (jKHjl (using (jSOI)) to get 



V9o(a + A;)v2o(& - ^) 



and (pQ{a + k) + (pQ{b — k) 



Thus, similarly to (j3T|) . we can determine 

{^(a + /c),^(6-/i;)} 



(54) 



clS cl function of elements of Q. 

Now define m =^ sup{j < /c — 1 : ^(a + j) 7^ ^(& — j)}. If there is no such j, there is 
no problem in finding 



{(v9o(a), . . . , <foia + k)), {ipo{b), (po{b - k))} 

from (jH^ and so without loss of generality, assume such a j exists. 
Now notice that 

Qli ,m,,m,£,k,k,£) 

and hence 



(55) 



(po{a + m)(po{b - k) + (po{b - m)(poia + k) 



8Q' 



(e,m,m,e,k,k,e) 



(56) 
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From the two unordered pairs (which we aheady know) 

{Tp^{a + m),Tp^{b-m)} and {Tp^{a + k),Tp^{b - k)} 
we can get two possible pairings: 

Fgood { + rn),'(p^{a + k)), {Tp^{h - m),Tp^{h - k)) } 

and (57) 

Fbad = { {^{a + m),(p^{b - k)), {Tp^{h - m) ,Tp^{a + k)) } . 
From these two pairings we can compute the values 

fgood =^ W(a + m)Tp^{a + k) + Tp^{h - m)Tp^{h - k) 

and . (58) 

fbad =^ W(a + m)Tp^{h - k) + Tp^{h - m)Tp^{a + k) 

Since we have written fbad in (fKHjl as a function of elements of Q, we can use these elements 
to discard the pairing Fbad in (jHTj) from which it comes. If fbad = fgood, we cannot determine 
the proper pairing. But this happens if and only if 

lp^{a + k) {Tp^{a + m) - Tp^{h - m)) = Tp^{h - k) {Tp^{a + m) - Tp^(h - m)) . (59) 

Since m was defined so that ^(a + m) — TpQ{h — m) 7^ 0, we conclude that ()59|1 is valid if 
and only if Tp^{a + k) = Tp^ip — k) . But in this case, it is clear that (jHKjl can be found from 
dHl and 

Otherwise, we can pick out Fgood from (jSTj), and hence we can determine 
Thus, by induction, we can determine 

{(^(a),...,^(6)),(^(6),...,^(a))}. (60) 

To summarize, we have just shown for any bounded measurable function if obeying the 
condition ^(a)^(6) 7^ we can determine 

ma),... Mb)]. (61) 

Now suppose that ^(a)^(6) = 0. Recall that the elements of $1 are enumerated as 
{hi, . . . , hn, ■ ■ ■)■ If we define n* as the smallest n so that {/i„(a) — Jj^ hnda, hn{b) — hnda) 

has distinct non-zero elements, then Lemma fH.9l guarantees that n* < 00. Let if) == hn*. 
There is a c G Q small enough so that 

(pQ + ci>Q{a) Q and v^o + cV'o(&) 7^ . 
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We can determine [cipo^a), . . . , cipo{b)], and [ipo + cipo{a), . . . ,ipQ + c4>o{b)]. 
Thus we can determine the two quantities 

1^0 + cipoia) -cipo{a),...,^o + cipoih) - cipoih)] 

and 

[v?o + ci)o{a) -c^o{b),...,(fo + c^o{b) - c^o{a)] 

But the end points of the second expression are nonzero for c small enough, while at least 
one endpoint in the first express is zero. Thus we can pick out the first expression, which 
allows us to determine 

The careful reader will have noticed that our use of Lemma I3.9l requires that 7]{a) ^ ^{b). 
If this is not the case, then Tp^{a) = Tp^ib) = 0. We can then apply the entire procedure 
with i — 2,a + l,b — 1 replacing i, a and b respectively. 

Now we have shown that we can determine 

( [^(a), . . . , WW], ma), . . . , W(&)], . . . ) • (62) 

Our goal now is to find 

[iVk{a))T=i > M« + l))^i , • • • , (^(^))^i] , 

which, since $ is measure determining, yields [77(a), ?7(a+ 1), . . . , 77(6)]. Again, we use 
induction. Suppose that we know 

[(W(a),...,W7T(a)), (w(6),...,wrT(6))]. (63) 

From (jn21), we have in particular 

[W(a),...,W(6)]. (64) 
There are two possible extensions of (j63|l using (j6l|l : 

,(W(6),...,W7T(6),W(6))] 

(65) 

, (W(6), . . . , WZT(6), W(a))] 

We want to guarantee that we can pick out Ggood from {Ggood, Gbad} given in 
Suppose there is some j so that 

{Tp^{a + j),...,Tp^{a+j)) ^ (W(6- j),...,WZT(6- j)) . (66) 



and 

Gbad == [{Vi{a), ■ ■ ■ ,W^{a),mb)) , • • • 
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This is without loss of generahty, since if there is no such j, then of course we can extend 
(jnni) to obtain 

• • • , , • • • , iWib), . . . , W(^))] • (67) 

Since the hnear functionals on R'^"^ separate points, there exist c G M'^^^ so that if Tc{x) = 
(c, x), then 

( (^(a + + j)) ) 7^ ( (^(6 - j), • • • - j)) ) • 

Since for any function ip we can recover (jUOj) . by hnearity of expectation, for the function 
Tc ( ((/?!, . . . , v^fc-i) ) + V'fc we can determine 

[^c(W(«), • • • • • ■,Tc(j^{b), . . . ,Tp^{h)) + Tp^{h))] (68) 

But from (j65|) . we can determine 



[Tc (v5i(a), . . . , V5fc-i(a)) + V5fc(a), • • • , (v9i(6), . . . , V5fe-i(&)) + '^k[ 

and (69) 
[Tc (^(a), . . . , ^^(a)) + ^(6), . . . , (^(6), . . . , ^^(6)) + ^(a)] 

It thus suffices to show that these two sets cannot be the same. If the sets in (|69|) are 
the same, then either ^(a + j) = Tp^{b — j) for all j, in which case there is no problem in 
obtaining (p7|) . or 

Tc(^(a+j),---,^fc^(a + j)) = Tc{Tp^{b- j),...,Tp^{b- j)) for all j . 

But Tc was defined to rule out this possibility. Hence we can distinguish the "correct" 
extension in (j65|) . and thus we can determine (j67|) . 
By induction, we can then determine 

m{a))Z„...,mib))k=i]- (70) 
Because the {(fk} are measure determining, from ()7U|) we can determine 

['r]{a),...,r]{b)]. 

Pick one £-tuple from [ri{a), . . . , 77(6)], and call it (770(1), • • • , Voi^))- Finally, define fj by 



fi{z) 



a if z < 1 or z > 
rio{z) ifl<z<i 
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5 Unsolved Problems 



There remain a couple of questions still requiring resolution: 

1. It follows from results in |Lin99j that if we allow infinitely many biased coins, then 
there exist bias configurations {0{z) : 2; G Z} that cannot be recovered up to a reflec- 
tion and shift. We have restricted attention to finitely many biased coins; however, 
the methods of this paper do allow recovery of infinitely many biases (up to reflection 
and shift) if the biased coins are sufficiently sparse. It remains an open question to 
determine for which infinite sets of integers S can one recover the biases of biased 
coins located in 5* from the tosses observed by a random walker. 

2. We have shown in Theorem 12.31 that for symmetric walks with finite variance incre- 
ments, we can recover finitely many unknown distributions up to a shift and/or a 
reflection. We have not been able to generalize the algebraic results in Section El to 
walks which are asymmetric, yet still mean zero. In particular. Lemma (3.31 needs to 
be proven for a matrix with entries {P*(0, j) : 1 < i < r, —m < J < m}. We expect 
the following to hold: 

Conjecture 1. In the setting of theorem \2.'J[. suppose that the symmetry assumption 
on the walk S is replaced by the assumption that the walk S has mean-zero, non- 
symmetric increments of finite variance. Then rj can be recovered up to a shift only. 

3. In Theorem 12. 3t is it possible to replace the symmetric random walk on Z satisfying 
(P), by a general null-recurrent Markov chain that satisfies J2n'^n = 

(Here Un is the probability that the chain returns to its starting state after n steps.) 
The goal is to recover rj up to an automorphism of the Markov chain. 

Acknowledgements. We are grateful to Rich Bass for useful discussions, and to Alan Ham- 
mond and Gabor Pete for helpful comments on the manuscript. 
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